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A study was designed to assess the change in teacher 
attitudes and methods and student attitudes and achievement as a 
result of a Teacher Self-Appraisal Inservice Program which included 
workshops on behavioral objectives, principal-directed teaching 
skills sessions, and training in Flanders* Interaction Analysis and 
Roberson's Self-Appraisal. Throughout the year six videotapes were 
collected on each of 20 teachers; they were coded and interpreted and 
teachers provided with feedback. Statistical U^sts were conducted at 
the end of the year to determine if any significant changes took 
place in the following data: (1) I/D ratios using data from Flanders* 

system; (2) percent of time spent in categories 1, 2, and 3 of 
Flanders* system, in encouraging verbal and nonverbal categories of 
Roberson's system, in closed method of teaching as opposed to open 
method of teaching in Roberson's system; (3) student and teacher 
attitude test scores; and (4) pre-post scores on reading tests, on a 
semantic differential scale, and on Edwards* Personal Preference 
Scales. Implications of the findings are that (1) such a program 
increases the reading achievement of disadvantaged children; (2) 
writing behavioral objectives at all cognitive and affective levels 
seems to bring about more change in teacher methods than does 
training in classroom observation systems; and (3) a teacher's 
attitude toward the organizational climate of a school may be 
affected by whether or not he understands the feedback he receives 
concerning teaching. (JS) 
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INTHODUCTION 



Since 1965, the Orange Unified School District (Orange, C^lfomia) has be^ ex- 
ploring varicuo approaches of teacher in-service training in an attempt to improve 
mstruction and to increase achievement. The district desired to implement an in- 
service program that met' the staff needs and emphasized the classroom utilization 
of video equipment to record classroom behavior for analysis by the teachers in- 
volved. 

The results of the 1967-68 Teacher Self-Appraisal Program indicated that the 
use of video equi{ment as part of teacher in-service training did assist teachers in 
modifyii^ their behavior and did increase achievement. The .1968-69 Teacher Self- 
Appraisal Program was planned in an attempt to identify the effects on teachers of 
an in-service program that emphasized: 

1. use of video equipment in recording classroom behavior, 

2. developing and writing behavioral. objectives, 

3. principal-directed in-service sessions, 

4. observing, recording, and analyzing classroom behavior, and 

5. teaching skills training. 



PBOCEDURE 

The following program was implemented by the Teacher Self-Appraisal In-serviee 
staff: 

1. TXveniy teachers who worked with disadvanta^d children in grades kindergarten 
through six were selected at the beginning of the semester. 

2. The following data were collected from principals, teachers, and students at 
Esplanade, Jordan, and Killefer Schools; ^ 

Principals 

1. On-Slte Survey Form 
Teachers 

1. EPIC Teacher hiformation Form 

2. Halpin-Croft Questionnaire (Pre/Post) 

3. Semantic Differential (Pre/Post) 

4. Edwards Personal Preference Inventory (Pre/Post) 

Students 

1. EPIC Student Information Form 

2, Michigan StudeiU; Attitude 'Inventory (Pre/Post) 

3. Principals of Esplanade, Jordan, and Killder attended a one -day workshop on 
Behavioral Objectives at the EPIC Evaluation Center in Tucson, Arizona. 
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4. A Behavioral Objectives woiicshop wae' conducted for teachers of Esplanade, 
Jordan, and Killcfer Schools involving fifty teachers, three principals, and 
three EPIC staff. 

5. In addition to objectives training, the following treatments were given to the 
teachers and principals of the three schools; 



School 


Staff 


Treatmerj 


Esplanade 


1 Principal 
7 Teachers 


Teaching Skills Sessions 

Coding Skills: Flanders* hiteractioa Analysis, 

Roberson's Self-Appraisal 




- 


Code Anal3^sis 
Data Interpretation 


Jordan 


1 Principal 
7 Teachers 


Teaclmg Skills Sessions 


Killefer 


1 Principal 


Coding Skills: Flanders* Interaction Analysis, 



Roberson-s Self-Appraisal 

Code Analysis 
Data Interpretaticm 

6, Tbroufi^out the year, six video tapes were collected on each teacher. 

7. The video tapes were coded and interpreted at the EPIC Evaluation Center and 
the teachers were provided with the feedback. 

/8, The principals and teachers were also responsible for keeping a weekly report 
concerning in-service activities and the amount of time spent writing behavioral 
objectives; 

9. Statistical tests were conducted at the end of the year to determine if any ^g- 
niflcant change took place in the following data: 

a. I/D ratios using data from Flanders^ System, 

b. Per cent of time spent In categories 1, 2, and 3 of Flanders* System, 

c. Per cent of time spent in encouraging verbal and non-verbal categories 

of Roberson's System, 

d. Per cent of time spent in closed method of teaching as opposed to open 
methods of teaching in Roberson's System, 

e. Student attitudes using the EPIC Attitude Inventory, 

f. Teacher attitudes using the Halpin-Croft Questionnaire, 

g. Pre-post scores on the Stanford Reading Test, 

h. Pre-post results on selected concepts using a semantic differential scale, 
and 

i. Pre-post teacher scores on the Edwards Personal Preference Scales. 
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Statistical Analysis of data . 
discussed in step nine of the procedure 
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OBJECTIVES 

OBJECTIVE #1 

Teachers partioipatiiig in tiie Teacher Self-Appraisal In-Service Program will 
respond positively toward the organizational climate of the school (organization) 
as measured by the Halpin-Croft Organizational Climate Description Question- 
naire: Form IV. 

It was hjq;x>thesized that those teachers who participated in the Teacher Self- 
Appraisal program would respond more positively toward the general organizational 
climate of the school. Responses were collected on a questionnaire which contained 
sixty-four statem^ts (i. e. , "Administrative paper w'ork is burdensome at this 
school. **)• Their responses were indicated on a four-point Likert Scale. 

The range of scores was 64-256. The low end of the scale indicates a nega- 
tiveness toward the schools' organizational climate. The higher end of the scale 
indicates a positive response. If a person received a score of 160^ this would in- 
dicate that he responded positively and negatively to an equal number of items. 

The analysis included the matching of pre- and post-score? on the instruments 
by teachers. A dependent t-test was then computed for each school and the total 
sample of teachers. 

Table 1 shows the results of the statistical analysis. 



TABLE 1. 

COMPAPJSON OF MEAN PRE- AND POST-SCORES ON THE 
. HALPIN-CROFT ORGANIZATIONAL CLIMATE DESCRIPTION QUESTIONNAIRE 



School 


N 


Pre-Mean 


Post-Mean 


Standard 

Error 


t 


Esplanade 


6 


175. 17 


175. 33 


48.49 


.02 


Jordan 


7 


198. 29 


190.43 


58.73 


-1.02 


Kiilefer 


6 


200. 33 


200. 50 


42.36 


.02 


Total 


19 


191. 63 


188.84 


16. 02 


- .70 



The results indicate that no significant changes occurred with respect to the 
teachers* responses toward the organizatioiial climate of their respective schools. 

However, it is interesting to note that although the teachers' responses from 
Esplanade and Kiilefer remained relatively stable, the responses of the Jordsin 
teachers did change toward the negative end. 

Again, although no cause and effect relationships can be concluded, it is pos- 
sible that a relationship exists between training in the observing and recording of 
classroom behavior and teacher response toward organi7.ational climate. 
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Also, data indicate that the teachers at Esplanade remained on the negative end 
of the scale on both the pre- and post-administrations of the instrument, while the 
Killefer teachers remained on the positive end of the scale on both administiatloos. 

Finally, as can be gathered from Table 1, there was not a significant change 
for the total sample, but the pre- and post-means are below the mean of 196, which 
indicates that the teachers tended to respond more in a negative fashion toward the 
items than in a positive fashion. 

OBJECTIVE #2 

Teachers participating in the Teacher Self-Appraisal In-Service Program will 
respmd positively toward improving their respective curricuiums as measured 
y the ^ount of time they spend (1) serving on curriculum and instructional 
committees, and (2) setting up district curriculum goidelines. 

Throughout the school year, the teachers were asked to keep a weekly record 
of how much time they spent serving on curriculum and instructional committees and 
setting district guidelines. The teachers participating in the in-service, program 
spent a total of thirty minutes on these activities. 

Although the results look discouraging on the surface, a possible reason for tiie 
teachers not spending iime serving in the above areas is that they may not have 
the o]^>ortunity to serve, due to the fact that committees whose purpose was to con- 
sider the improvement of curriculum were non-existent. If this was the case, the 
results seem reasonable. 

However, if these committees were available, then the in-service program was 
not successful in producing a willingness on the part of the teachers to spend time 
considering how their respective curricuiums might be improved. 

OBJECTIVE #3 

Teachers participating in the Teacher Self-Appraisal In-Service Program will 
resp^d positively toward the content of the in-service program as measured 
by th^e amount of time they spend (1) writing behavioral objectives, and (2) 
meeting with their respective principals for the purpose cf discussing and im- 
plementing the material presented in the in-service program. 

In order to get some indication as to how much time the teachers spent writing 
behavioral objectives and meeting with their principals to discuss the content of the 
in-service program, the teachers were asked to keep a weekly account cf the time 
they spent writing behavioral objectives, and the principals were asked to keep a 

record of how much time they spent meeting with their teachers to discuss the con- 
tent of the in-service progfram. 
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Tables 2 and 3 show the complied results of die teachers and. principals. 



TABLE 2 

COMPARISON BY SCHOOL OF THE AMOUNT OF TIME 
SPENT BY THE TEACHERS WRITING BEHAVIORAL OBJECTIVES 



School 



Behavioral Level 


Esplanade 


Jordan 


Killefer 


Total 


Mfn. 




Min. 




Min. 


zs 

/c 


Min. 




Cognitive 

Knowledge 


2882 


38 


870 


11 


665 


22 


4417 


24 


Comprehension 


875 


11 


1145 


15 


480 


16 


2500 


14 


Application 


737 


10 


1540 


20 


215 


7 


2492 


13 


Analysis 


335 


5 


1685 


22 


390 


13 


2460 


13 


Synthesis 


275 


4 


1255 


16 


465 


15 


1995 


11 


Evaluation 


637 


8 


1055 


14 


360 


. 12 


2052 


11 


Affective 

Receiving 


717 


9 


70 


1 


150 


5 


937 


5 


Responding 


709 


9 


li5 


1 


305 


10 


1129 


6 


Valuing 


205 


4 


10 


0 


10 


0 


305 


2 


Organization 


160 


2 


0 


0 


0 


0 


160 


1 


Psychomotor 


0 


0 


0 


0 


0 


0 


0 


0 


Totals 


7992 


100 


7745 


100 


3040 


100 


18477 


100 



TABLE 3 

SUMMARY OF THE AMOUNT OF TIME SPENT BY SCHOOL BY THE 
PRINCIPALS MEETING WITH THE TEACHERS TO DISCUSS CONTENT 

OF THE IN-SERVIGE PROGRAM 



School 





Esplanade 


Jordan 


Killefer 


Total 




Topic 


Min. 




Min: 




Min. 


% 


Min. 


% 


Objectives 
Roberson's Teacher 


28 


3 


410 


58 . 


360 


30 

% 


798 


28 


Self-Appraisal 
Flanders’ Interaction 


402 


45 


0 


0 


430 


35 


832 


30 


Analysis 


319 


36 


0 


0 


410 


34 


729 


26 


Other 


145 


16 


295 


42 


15 


1 


455 


16 


Totals 


894 


100 


705 


100 


1215 


100 


2814 100 



As for the teachers, the com^led results show that a large amount of time was- 
spent writing objectives at the various behavioral levels. Also, a considerable 
amount of time was spent by the principals discussing the content of the in-service 
program. It should be noted, however, that the reason the principal at Jordan did 
not spend any time discussing the Flanders* and Roberson’s Observation Systems 
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was that the teachers did not receive any training in the observing and recording of 
classroom behavior during the in-service program. 

However, a very interesting relationship tends to exist between the. teacher and 
principal time accounting results. Because the Jordan teachers did not receive any 
training in classroom observation systems, the principal and. teachers had a greater 
opportunity to discuss behavioral objectives than the teachers and principals at the 
other two schools. 

Consequently, the Jordan principal and teachers spent more time than the other 
two schools discussing behavioral objectives. This appears to have resulted in more 
time spent by the Jordan teachers writing objectives at the higher behavioral levels 
than the teachers at the other two schools. This is somewhat supported by the fact 
that the teachers at Esplanade and Killefer spent 38% and 22% of their time writing 
objectives at the knowledge level, while the Jordan teachers spent only 11% of their 
time at the knowledge level. 

OBJECTIVE H4 

Teachers participating in the Teacher Self-Appraisal In-Service Program will 
apply a range of methods in the classroom in working with disadvantaged stu- 
dents as determined by (1) the interaction analysis I/D ratio, which is the 
amount of time spent by the teachers in categories 1, 2, 3, and 4 as conipared- 
to the amount of time spent in categories 5, 6, and 7 of Flanders' Interaction 
Analysis System, and (2) the amount of time spent by the teachers in the closed 
arrf open methods categories of Roberson's Teacher Self-Appraisal System. 

In order to determine if the participating teachers in the in-service program ap- 
plied a range of methods, samples of their teaching behaviors were collected on 
video tape throughout the year. Tlie video tapes were then coded using Flanders' 
and Roberson's observation systems. I/D ratios and percentages of time spent in 
closed and open methods were computed for each tape. An analysis of variance 
was then computed on each school's data to determine if any significant change took 
place In the teacher's behavior during the school year. 

Table 4 shows by school and tape the mean I/D ratios and the mean percentage 
difference in time the teachers spent in a closed method of teaching as opposed to 
an open method of teaching. The F values from the statistical tests are also re- 
ported. 

The results indicate that significant differences did occur for the Jordan teach- 
ers on the closed and open methods of teaching, while the Killefer teachers had a 
significant difference on the l/D ratio between their six video tapes. It should be 
noted that the t-test computed on the I/D ratio of the Jordan teachers was signifi- 
cant at the .1 level. 
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It was originally hypothesized that the Esplanade and Killefer te,achers would 
show a larger range of methods in teaching because they were trained in Flanders* 
and Rober8cn*8 systems during the in-service program. The Jordan teachers, act- 
ing as the control group, did not experience the training. 

However, when one views the results in Table 4, they indicate that the Jordan 
teachers appeared to show more significant changes in methods between video tapes 
than did the Esplanade and Killefer teachei^. 

One might conclude that training in observation systems, such as Flanders* and 
Roberson*s, does not necessarily result in the teachers applying a range of methods 
in teaching, since the Jordan teachers (who did not experience any gaining of this 
type) showed the largest changes in methods. 

The next question is: ”What might have caused this change in the Jordan teach- 
ers?'* Althou^ cause and effect relationships cannot be implied, it is interesting to 
note that, according to the results in Table 2, the Jordan teachers spent more time 
writing behavioral objectives at the hi^er behavicral levels than the teachers at the 
other two schools. The Killefer teachers were next in line in te^s of. spending 
more time writing objectives at the higher behavioral level and, as the results in- 
dicate, they showed a significant difference in their l/D ratios. The Esplanade 
teachers who spent 38% in writing objectives at the knowledge level showed no 
change in methods, according to Flanders* and Roberson's systems. 

The conclusion might be drawn that if the objective is to have teachers apply a 
range of methods in the classroom, learning in observation systems may not be the 
answer, but instead have the teachers write behavioral objectives at all levels of 
(he cognitive and affective domains and not just at the knowledge level. Conse- 
quently, if the assumption can be made that one method of teaching cannot be used 
to accomplish objectives at the behavioral levels, then the teacher who has a wide 
range of behavioral objectives to begin with would more than likely have to apply 
a range of teaching methods in order to accomplish them. In other words, given 
a vidde range of objectives, including all behavioral levels, might automatically 
lead to a wide application of different teaching methods. 

OBJECTIVE #5 

Teachers participating in the Teacher Self-Appraisal In-Service Program will 
show acceptance of the problems and values of disadvantaged students as dem- 
onstrated by their responses in categories 1, 2, and 3 of Flanders’ biteractloD 
Analysis System and the categories of verbal and non-verbal encouraging ex- 
pressions of Roberson's Teacher Self-Appraisal Observation System. 
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It was hypothesized that those teachers participating in ttie Teacher Self-Appraisal 
Program would, throu^out the year, continually increase their use of categories 1, 2, 
aim! 3 of Flanders' interaction Analysis System and the sui^rting, helping, and re- 
ceptive categories of Roberson's Teacher Self-Appraisal System. 

The analysis was carried out by first calculating the mean per cent of time the 
teachers from the three schools used the first three categories of Flanders' System 
and the verbal and non-verbal encouraging categories of Roberson's System for each 
video tape. 

An analysis of variance was then computed using the- results from each schcol 
to determine if any significant differences occurred. Table 5 shouts, by school and 
tape, the mean per cent of time the teswhers used the previously specified categories 
of Flanders' and Roberson's Systems, The resulting statistical teste are also re- 
ported. 

TABLE 5 

COMPARISONS OF MEAN PER CENTS FOR CATEGORIES 1. 2. AND 3 OF 
FLANDERS' INTERACTION ANALYSIS SYSTEM AND VERBAL AND 
NON-VERBAL ENCOURAGING CATEGORIES IN ROBERSON'S 
TEACHER SELF-APPRAISAL SYSTEM 



- 


Esplanade 


Jordan 


Killefer 


TAPE #1 


- 




4. 84 


I.A. System 


3.73 


3.53 


TSA Verbal 


51. 29 


37.86 • 


45. 83 


TSA Non-Verbal 


65.71 


69. 86 


71. 16 


TAPE #2 

LA. System 


5. 12 


3. 17 


3. 91 


TSA Verbal 


7L 57 


33.71 


71.83 


TSA Non-Verbal 


87. 42 


70. 57 


79.16 


TAPE #3 






3.03 


LA. System 


3.32 


3.37 


TSA Verbal 


62.42 


62. 86 


70. 16 


TSA Non-Verbal 


80. 85 


34. 71 


90. 16 


TAPE #4 


LA. System 


1.80 


3.22 


2. 95 


TSA Verbal 


63.14 


64. 86 


71.50 


TSA Non-Verbal 


76. 28 


75. 57 


88: 16 


TAPE #5 

la. System 


• 


2.35 


7. 50 


TSA Verbal 




78.71 


74. 16 


TSA Non- Verbal 




74.29 


85. 16 
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TABI>E 5 (Continued) 



Esplanade 



Jordan 



KUlefer 



TAPE #6 



I. A. System 
TSA Verbal 
TSA Non-Verbal 



3.64 

7S.43 

71.86 



6.54 
74. 00 
96. 83 



F 



I. A. System 
TSA -Verbal 
TSA Non-Verbal 



1. 13 
2. 56 
4. 97-5' 



.59 

16, 77** 
1. 05 



1. 91 
8 . 88 ** 
1.73 



**’(.05, 3, 18) 
“(.01, 5, 18) 



= 3. 16, significant at . 05 level 
= 4.25, significant at .01 level 




The results show that no significant change took place tn the teachers' use of 
categories 1, 2, and 3 of Flanders’ ^stem. A significant change in the EsplaTiade 
teachers' use of the Roberson non-verbal encouraging categories did take pjUuie, 
where the Jordan and KUlefer teachers changed significantly on Che Roberson ver- 
bal encouraging categories. 

One can see tL i. the three significant changes which took place resulted from 
a general increase in the teachers' use of the Roberson verbal and non-verbal en- 
couraging categories from one tape to the next. 

It is not ai^arent why significant chaises took place in the Roberson System 
and not in the Flanders System. 

However, a possible reason might be that the definitions of categories 1, 2, 
and 3 in Flanders' System are more restricting than the definitions of the verbal 
end non-verbal encouraging categories of Roberson's System. This restriction in 
definition might tend to limit or decrease the amount of teacher behavior that could 
be categorized in categories 1, 2, and 3 of Flanders' System, whereas if the def- 
initions were broader, as might be the case in Roberson's System, the teachers 
would have larger opportunity to use them. 

If the above is true, it W'ould be unlikely to expect a change in Flanders* Sys- 
tem, since one would be concerned with a very small amount of teacher behavior 
and, consequently, would have very little opportunity for observing a large signif- 
icant change. 

This notion Is somewhat supported by the data in Table 5 since the largest 
mean per cent reported in Flanders’ System was 6.54% of the teachers* verbal 
behavior. 
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OBJECTIVE #6 

Studdcto of classroom teachers participating in the Teacher Self-Appraisal In- 

Service Program will respond positively toward objects in the school environ- 
. ment (organization) as measured by the EPIC Attitude Inventory. 

It was hypothesized that if the Teacher Self-Ai^raisal In-Service Program was 
succeBshil, the participating teachers could change their behavior in the classroom 
to an extent that this change would produce more positive responses on the part of 
the children toward such miiigs as school, teacher^ school work, and general class- 
room environment. 

The responses of the children were collected using a thirty-four item question- 
naire. The answers of the children were indicated on an answer sheet upon which 
they could circle cither ”yes” or **no. ” 

Items 10 and 23 were the same and if the child responded differently to these 
items, he was not used in the statistical. analysis. Item 34 was not included in 
any child's total score since it was used to determine if he was responding to the 
questions appropriately. If tiie child indicated that a penny was not worth more 
than a nickel, he was eliminated from the statistical analysis. 

The total range of scores was 0-66. The low end of the scale would indicate 
a negative response, while the hi^ end of the scale would indicate a positive re- 
sponse. A score of 33 would indicate that a child responded positively and neg- 
atively to an equal number of items. 

The analysis was carried out by matching each child on his pre- and post- 
scores on the EPIC Attitude Inventory and then conq>utmg a dependent t-test for 
each school participating in the in-service program. 

Table 6 shows the results of the statistical analysis. 

TABLE 6 

COMPARISON OF PRE- ANT) POST-MEAN SCORES ON. THE 

EPIC ATTITUDE INVENTORY 



School 


N 


Pre -Moan 


Post-Mean 


Standard 


t 










Error 




Esplanade 


116 


49.72 


50. 21 


.92 


.51 


Jordan 


77 


43.87 


37.71 


1.84 


-4.53* 


Killefer 


78 


51.36 


50. 91 


.96 


- .46 


Total 271 


48.53 


46.86 


.42 


-2. 57** 


*‘(.01, 76) 


= 2.64, significant 


at . 01 level 








**‘(.05, 70) 


= 1. 96, significant at . 05 level 
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The results indicate that a significant positive change did not occur in any of 
the three schools. However, the children at the Jordan Elementary School did show 
a significant change in the negative direction. 

In addition, when a t-test was computed on the total sample, the results Indi- 
cated a significant negative change in the childrens responses. However, this change 
can probably be attributed largely to the result of the Jordan children. 

It is interesting to note that the Jordan childrens pre-test scores were lower than 
the other schools to begin with. It should also be noted that the teachers at Jordan 
dd not receive any training in the observing and recording of classroom behavior, 
while the other teachers at Esplanade and Killefer did receive training in Flanders* 
hiteraction Analysis System and Roberson's Teacher Self-Aj^raisai System. 

Although no cause and effect relationships can be concluded, the data do suggest 
tiiat there might be a relationship beb;‘/een teacher training in the observing and re- 
cording of classroom behavior aud childrens responses -to the school environment. 

OBJECTIVE #7 

Students of classroom teachers participating in the Teacher Self-Appraisal In- 
service Progpram will increase their knowledge of reading as determined by 
their scores on the Stanford Achievement Test. 



Although grades K-6 are represented by the participating teachers in the in- 
service program, only grades 2 and 3 were used to assess the degp'ee to wMch this 
objective was accomplished, due to a change in achievement instruments as some 
children moved from one grade to the next. 

Since the achievement data for each school was rather limited for grades 2 and 
3, it was not possible to perform the statistical analysis for each school separately. 
Therefore, dependent t-tests were calculated using all children from the three 
schools. 

Table 7 shows the pre- and post-achievement means for grades 2 and 3, along 
with the resulting t-tests. 

TABIJS 7 

PRE- AND POST-COMPARISON OF READING ACHIEVEMENT 

FOR GRADES 2 AND 3 



Grade 



N 



Pre -Mean Post-Mean 



Standard 

Error 



Two 16 24. .94 30.75 3.87 2.96* 

Three 29 27.79 42.86 3.09 8.56** 

*^15, .01 one-tailed) ^ at .01 level 

**^(27, .02 one-tailed) ” significant at .01 level 
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Ttie results Indicate that there was a significant gain in reading achievement for 
those children in gprades 2 and 3 whose teachers were participants in the Teacher 
^1£-Appraisal In-Service Program. 

In the school year 1967-68, the achievement of those disadvantaged children 
who had teachers participating in the Teacher Seif-Appraisal Program was con^ied 
to the achievement of a control group of middle-class children. The result showed 
that although the middle-class children were achieving at a higher level, the gap in 
achievement between the middle-class children and disadvantaged children decreased 
fiom the pre -achievement means to the post-achievement means. 

In order to determine if the achievement ga^p was furfiier decreased this year as 
a result of the Teacher Self-Appraisal Program, a conrxparison was made between the 
control group's reading achievement mean and this year's achievement results. 

Table 8 shews the pre- and post-means of the control group's reading achieve- 
ment compared to pre- and post-reading achlevernent scores of disadvantaged chil- . 
dren for the school years 1967-68 and 1968-69. 



TABLE 8 

PRE- AND POST-READING ACHIEVEMENT COMPARISONS OF CONTROL 
AND DISADVANTAGED GROUPS FOR 1967-68 and 1968-69 



Pre-Means 




Post-Means 




* 


Dis. 

Control67-68 


Dis. 

68-69 


Diff. 

67-68 


Diff. 

68-69 


Control 


Dis. 

67-68 


Dis. 

68-69 


DifL 

67-68 


Difi. 

68-69 


GRADE 2: 


















15.86 11.23 


24.94 


4. 63 


-9. 08 


27.26 


22.36 


30.75 


4.90 


-3.49 


GRADE 3: 


















257.26 22.36 


27.79 


4.90 


- .53 


27.49 


21. 16 


42. 86 


6.33 


-15. 37 



As the comparisons show, the gap which existed between the control group and 
disadvantaged children in reading achievement at the end of the 1967-68 school year 
has completely disappeared during the school year 1968-69 and the disadvantaged 
children are now achieving at a higher level than the control group. 

LIMITATIONS 

This study was designed to assess the change in teacher attitudes and methods 
and student attitudes and achievement as a result of the Orange Unified School Dis- 
trict's Teacher Self-Appraisal In-Service Program. 
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When interpreting the results , the following limitations should be considered: 

1. The validity of the measuring instruments, 

2. The reliability of the measuring instruments, 

3. The probability of making Type I and Type II errors, and 

4. The sample size. 

The results of this study should only be generalized to that population which 
the sample was intended to represent. 

IMPLICATI(»rS 

Three implications ma}' be derived from this study. First of all, it appears that 
an in-service program of the type performed in the Orange Unified School District 
does have an effect of increasing the reading achievement of disadvantaged children. 

Secondly, this study has implications for bringing about change in teacher meth- 
ods. The results show that the writing of bebaidoral objectives at all cognitive and 
. affective levels seems to bring about more change in teacher methods than training 
In classroom observation systems such as Flanders' and Roberson's Systems. A 
Study dealing with the effect of training in behavioral objectives and the resultant 
changes in teachers' methods would seem to be ^e next step in assessing the ef- 
fectivewess of the Orange Unified School District's hi-Servlce Program. 

It is also interesting to note that a teacher's attitude toward the organizational 
climate of a school may be a:Hected by whether or not the teacher understands the 
feedback he receives concerning his teaching. Ihe Jordan teachers seemed to con- 
firm this notion since they had a negative change in attitude toward their organiza- 
tional climate, while at the same time they received feedback about their teaching 
which they had a difficult time understanding, due to the fact that they had not ex- 
perienced any training in the Handers' and Roberson's Sj^stems. A study to In- 
vestigate further the effect of feedback on selected teacher variables would seem to 
be ai^ropriate in the next cycle of evaluating Orange Unified School District's In- 
Service Program. 



